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MSFC 

UAH Background 




• Major Flares and CMEs are known to be drivers of the most severe 
space weather 

• Most major Flares and CMEs come from Sunspot active regions 

• Flares and CMEs are exceptionally large explosive releases of free 
magnetic energy stored in the corona 

• While the amount of free energy cannot be measured directly, free- 
energy proxies can be measured 

• Event rates have been shown to be correlated with the magnitude of 
the free-energy proxies 

• We will demonstrate that our MAG4 forecasting 
techniques are more accurate than either the McIntosh 
or Total Magnetic Flux forecasting techniques 
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Magnetogram Measures 



• When the transverse 
gradient of the vertical (or 
line-of-sight) magnetic field is 
large at the neutral line, there 
is more free-energy stored in 
the magnetic field 

• For each Active Region: 

The integral of the gradient 
along the neutral line is the 
AR’s free-energy proxy 

• The sum of flux from all 
pixels having more than 100 
G is our total magnetic flux. 


A magnetogram of an active region 
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Converting Free-Energy Proxy to Predicted Event Rates 

Present MAG4 
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Forecasting Curves Free-Energy Proxy W(kG) 


These empirical forecasting curves are used to convert our free-energy proxy into 
predicted event rates. Curves are derived from a sample of 40,000 
magnetograms, from 1300 active regions observed between 1996-2004. 

Similar curves can be derived for total magnetic flux 


- - - - - - - 1 

Mojor Flores 



o.ioo 


- - 0.010 


AAS/SPD June 5, 2014 


4 




X&M Flore Rote (doy" 


MSFC 

UAH 


Forecasting Curves based on Free Energy and Prior Flaring 

Upqraded MAG4 





Free-Energy Proxy W(kG) 


Active regions that have recently produced a major flare (X- or M-Class) 
are more likely to produce major flares in the near future 
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McIntosh AR Classes and Using Them for Forecasting 




MODIFIED 
ZURICH CLAS-5 


McIntosh 

Sunspot Group Ckissiiication 
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Spotclass 

AR-Days 

M-class 

X-class 

Rates 

FHC 

10 

11 

- 

1.10 

DHC 

3 

3 

- 

1.00 

FKC 

217 

177 

32 

0.96 

EKC 

223 

112 

18 

0.58 

DKC 

82 

38 

5 

0.52 

ERO 

2 

1 

- 

0.50 

FHI 

10 

5 

- 

0.50 

FKI 

184 

80 

9 

0.48 

CKI 

3 

1 

- 

0.33 

DHI 

7 

2 

- 

0.29 


• There are 60 valid McIntosh 
classes 

• Only 7 of these have M and X- 
class event rates of greater than 
0.5 flares a day 

• Any active region in the control 
sample with one of these seven 
spot classes, receives a forecast 
of yes; for all others, the forecast 
is no. 


McIntosh (1990) 
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MSFC Statistical Measurement of the Difference in Performance 
UAH of Alternative Forecasting Techniques 




How we evaluate which forecasting technique is best 

• Randomly divide sample by AR into control and experimental halves 

• Derive forecasting curves from control half 

• For each technique make forecasts for the experimental half 

- For McIntosh we use NOAA’s tables 

- For all others we use the forecasting curves derived from the 
control half on the experimental half 

- If predicted event rate is above 0.5 major flares a day, we forecast 
yes, else forecast no (we tried other thresholds and got similar 
results) 

• Determine the Two-by-Two Contingency Table for each forecasting 
technique, and 

- Obtain values of five performance metrics for each technique. 

- For each technique obtain the difference in the value of each metric 
and the value of that metric for the Present MAG4 forecast 

• Repeat Random division 2000 times 
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MSFC Two Methods of Evaluating which Forecasting Technique 
UAH 
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Heidke Skill Score 

HSS = (A+D-E)/(N-E) 

N = A+B+C+D 

E = ((A+B)(A+C)+(B+D)(C+D))/N 
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Conclusions 




• We have developed a method to measure which 
forecasting technique is better and the statistical 
significance of the difference 

• Ranking of Forecasting Methods from best to worse 

Upgraded MAG4 Free-energy proxy and previous flare activity 

- Present MAG4 Free-energy proxy only 

McIntosh or Total Magnetic Flux 


Published Paper 

Falconer, D. A., Moore, R. L., Barghouty, A. F., and Khazanov, I., 2014, 
“MAG4 versus Alternative Techniques for Forecasting Active-Region 
Flare Productivity,” Space Weather, published online, 5 MAY 2014 
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How Well Does MAG4 Forecast: 




Predict Yes 
Predict No 


YY YN 

NY NN 

Metric Equations 


Percent Correct 
Probability of Detection 
False Alarm Rate 
Heidke Skill Score 

True Skill Score 


PC=(YY+NN)/(YY+YN+NY+YY) 

POD=YY/(YY+NY) 

FAR=YN/(YY+YN) 

HSS=2*(YY*NN-YN*NY)/[(YY+NY)* 

(NY+ N N )+( YY+ YN )*( YN + N N )] 
TSS=(YY*NN-NY*YN)/((YY+NY)*(YN+NN)) 
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All Metrics 


Improvement in Metric 


Mclntosh/NOAA 

1.8±0.5 

0.02±0.05 

Present MAG4 

(4a) 

(0.3a) 

Total Magnetic Flux 

0.1±0.3 

0.16±0.07 

Present MAG4 

(0.3a) 

(2a) 

Present MAG4 

0.2±0.2 

0.08±0.03 

Upgraded MAG4 

(0.7a) 

(2a) 
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Free-Magnetic Energy 



Contours Vertical Magnetic Field 

Arrows Transverse Magnetic Field Currents ~10 Amps 








Size Free Magnetic Energy 

Or Nonpotentiality ‘ 
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What is MAG4? 




• MAG4 (Magnetogram Forecast), developed originally for NASA/SRAG 
(Space Radiation Analysis Group), is an automated program that 
analyzes magnetograms from the HMI (Helioseismic and Magnetic 
Imager) instrument on NASA SDO (Solar Dynamics Observatory), and 
automatically converts the rate (or probability) of major flares (M- and 
X-class), Coronal Mass Ejections (CMEs), and Solar Energetic Particle 
Events 

• MAG4 does not forecast that a flare will occur at a particular time in the 
next 24 or 48 hours; rather the probability of one occurring! 

• GONG ( Global Oscillations Network Group ) magnetograms, can be 
used instead as a backup but at a lower forecast accuracy 

• Present cadence of new forecasts: 96 minutes 
Vector magnetogram actual cadence: 12 minutes 
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